Reception apparatus, reception method, and image processing system

ABSTRACT

The present disclosure relates to a reception apparatus, a reception method, and an image processing system that can suppress a reduction in resolution of an image that a surgery operator wants to see at a high resolution while responding to an increase in the number of connections of medical equipment that supply images. In the previous stage of a transmission path such as PCIe, images are acquired from a plurality of pieces of medical equipment, a compression method is selected for each type of image, and the image is compressed and output to the transmission path. Therefore, among YCbCr signals, e.g., of a CT image or an X image, an image that does not require CbCr signals is compressed as the Y signal only, and an image that requires a high-resolution image such as an operative field image is transmitted without being compressed. Therefore, it is possible to suppress compression of the band of a transmission path such as PCIe. The present disclosure can be applied to an intra-hospital image processing system.

TECHNICAL FIELD

The present disclosure relates to a reception apparatus, a receptionmethod, and an image processing system, and particularly to a receptionapparatus, a reception method, and an image processing system that cansuppress a reduction in resolution of an image that a surgery operatorwants to see at a high resolution while responding to an increase in thenumber of connections of medical equipment that supply images.

BACKGROUND ART

In recent years, medical images from a plurality of medical equipmenthas been combined into a single display image and the plurality ofmedical images is simultaneously displayed on a display apparatus suchthat various information can be read simultaneously to improve surgicalefficiency and reduce the surgery room occupancy by the displayapparatus.

For example, a technique for combining medical images of a plurality ofmedical equipment into a single display image and displaying it on adisplay apparatus (HMD) is disclosed (see Patent Document 1).

CITATION LIST Patent Document

-   Patent Document 1: Japanese Patent Application Laid-Open No.    2015-19679

SUMMARY OF THE INVENTION Problems to be Solved by the Invention

However, in order to combine medical images from a plurality of medicalequipment into a single display image and simultaneously display theplurality of medical images on the display apparatus, it is necessary totransmit and receive the plurality of medical images from the pluralityof medical equipment, and therefore the data transmission band iscompressed in some cases.

Thus, a conceivable way would be to secure the data transmission band byreducing the number of connected medical equipment, but reducing thenumber of connected medical equipment reduces the number of images thatcan be displayed.

Furthermore, a conceivable way would be a method of uniformly reducingthe data capacity output from the medical equipment, but when the datacapacity is uniformly reduced, the resolution of the image that thesurgery operator wants to see as a high-resolution image is reduced.

The present disclosure has been made in view of such a situation, andparticularly suppresses a reduction in resolution of an image that asurgery operator wants to see at a high resolution while responding toan increase in the number of connections of medical equipment thatsupply images.

Solutions to Problems

The reception apparatus according to a first aspect of the presentdisclosure is a reception apparatus including: an acquisition unit thatacquires an image from a plurality of pieces of equipment; and aplurality of compression units that compresses the image acquired by theacquisition unit by selecting a compression method for each type of theimage.

The reception method according to a first aspect of the presentdisclosure is a reception method including: acquisition processing ofacquiring an image from a plurality of pieces of equipment; andcompression processing of compressing the image acquired by theacquisition processing by selecting a compression method for each typeof the image.

According to the first aspect of the present disclosure, images areacquired from a plurality of pieces of equipment, and the acquiredimages are compressed by selecting a compression method for each type ofthe image.

The image processing system according to a second aspect of the presentdisclosure is an image processing system including: an image server thatstores an image from a plurality of pieces of equipment; and a receptionapparatus that acquires an image from the image server, outputs theimage to a display unit, and causes the display unit to display theimage, in which the image server stores an image from the plurality ofpieces of equipment and includes an output unit that outputs the storedimage to the reception apparatus, and the reception apparatus includesan acquisition unit that acquires the image from the plurality of piecesof equipment from the image server and a plurality of compression unitsthat compresses the image acquired by the acquisition unit by selectinga compression method for each type of the image.

According to the second aspect of the present disclosure, the imageserver stores images from the plurality of pieces of equipment, thestored images are output to the reception apparatus, the receptionapparatus causes the plurality of images from the plurality of pieces ofequipment to be acquired from the image server, and the acquired imageis compressed by selecting a compression method for each type of theimage.

Effects of the Invention

According to one aspect of the present disclosure, it is particularlypossible to suppress a reduction in resolution of an image that asurgery operator wants to see at a high resolution while responding toan increase in the number of connections of medical equipment thatsupply images.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram explaining an overview of an IP converter receptionapparatus.

FIG. 2 is a diagram explaining a configuration example of anintra-hospital image processing system of the present disclosure.

FIG. 3 is a diagram explaining a configuration example of a firstembodiment of the IP converter reception apparatus.

FIG. 4 is a flowchart explaining display control processing by the IPconverter reception apparatus of FIG. 3.

FIG. 5 is a diagram explaining a configuration example of a secondembodiment of the IP converter reception apparatus.

FIG. 6 is a flowchart explaining display control processing by the IPconverter reception apparatus of FIG. 5.

FIG. 7 is a diagram explaining a configuration example of a thirdembodiment of the IP converter reception apparatus.

FIG. 8 is a diagram explaining a bit packing format.

FIG. 9 is a diagram explaining an example of switching a bit packingformat according to a processing load of a GPU.

FIG. 10 is a flowchart explaining display control processing by the IPconverter reception apparatus of FIG. 7.

FIG. 11 is a diagram explaining a configuration example of ageneral-purpose personal computer.

FIG. 12 is a diagram schematically showing the overall configuration ofa surgery room system.

FIG. 13 is a diagram showing a display example of a manipulation screenon a centralized manipulation panel.

FIG. 14 is a diagram showing an example of a state of a surgery to whichthe surgery room system is applied.

FIG. 15 is a block diagram showing an example of a functionalconfiguration of a camera head and a CCU shown in FIG. 14.

MODE FOR CARRYING OUT THE INVENTION

Preferred embodiments of the present disclosure will be described indetail below with reference to the accompanying drawings. Note that, inthis description and the drawings, configuration elements that havesubstantially the same function and configuration are denoted with thesame reference numerals, and repeated explanation is omitted.

Aspects for carrying out the present technology are described below. Thedescription is provided in the order set forth below.

1. Overview of the IP converter reception apparatus (IPC)

2. Configuration example of the intra-hospital image processing systemof the present disclosure

3. Configuration example of the first embodiment of the IP converterreception apparatus

4. Configuration example of the second embodiment of the IP converterreception apparatus

5. Configuration example of the third embodiment of the IP converterreception apparatus

6. Example of execution by software

7. Application example

1. Overview of the IP Converter Reception Apparatus (IPC)

The overview of an interlace protocol (IP) converter reception apparatus(IPC) will be described with reference to FIG. 1.

FIG. 1 shows a configuration example of an IP converter receptionapparatus (IPC-Rx) 11.

The IP converter reception apparatus (IPC-Rx) 11 receives a plurality ofIP-packetized images, combines them into a single image (PinP image),converts it into an image signal, and outputs the image signal to amonitor to cause the monitor to display the image.

In the present specification, the IP converter reception apparatus(IPC-Rx) 11 combines an image preliminarily captured in a hospital or animage during surgery into a single image for presentation to the surgeryoperator, converts it into a predetermined image signal, and outputs theimage signal to a monitor to cause the monitor to display the image.

More specifically, the IP converter reception apparatus (IPC-Rx) 11includes an input unit (Network Rx) 31, decoders (Decoder) 32-1 to 32-n,an expansion bus (peripheral component interconnect express (PCIe)) 33,a graphics processing unit (GPU) 34, and an output unit (serial digitalinterface (SDI)-Tx) 35.

The input unit 31 is a serial interface, and receives, in addition toIP-packetized images such as medical images preliminarily captured in ahospital, an input of a plurality of types of stream images such asimages currently captured during surgery, via a network (Network), andoutputs the images to the decoders 32-1 to 32-n that decode the streamimages according to the type.

The decoders (Decoder AAA to Decoder ZZZ) 32-1 to 32-n are decoders thatdecode the stream images according to the type of encoding, and outputthe decoded stream images to the expansion bus (PCIe) 33. Note that“AAA” to “ZZZ” in “Decoder AAA” to “Decoder ZZZ” in the drawing indicatethat they are decoders corresponding to different types of encoding.

The expansion bus (PCIe) 33 is a data transmission path between thedecoders 32-1 to 32-n and the GPU 34 and between the GPU 34 and theoutput unit (SDI-Tx) 35, outputs a plurality of decoded stream images tothe GPU 34, and outputs a single picture in picture (PinP) imagegenerated by the GPU 34 to the output unit (SDI-Tx) 35.

The GPU 34 generates a single picture in picture (PinP) image bycombining a plurality of images and outputs the PinP image to theexpansion bus 33.

The output unit (SDI-Tx) 35 converts the single PinP image into apredetermined image signal, outputs the image signal to a monitor(Monitor) provided in a surgery room and including a display such asliquid crystal display (LCD) and organic electro luminescence (EL), andcauses the monitor to display the image.

With such a configuration, first, in addition to images such as CTimages and MRI images, an input of a plurality of types of IP-packetizedstream images such as operative field images, endoscopic images, andlaparoscopic images currently captured is received. Then, the inputstream images are decoded for each type, and the plurality of streamimages is combined to generate a single PinP image. The image isconverted into a predetermined image signal such as 3G-SDI, and issupplied to the monitor provided in a surgery room where the imagesignal is displayed as a single image.

By the way, the types of images input to the IP converter receptionapparatus 11 tend to increase year by year, and there has been apossibility that the band in the expansion bus (PCIe) 33 is compressedand a delay may occur in the display of the PinP image displayed on themonitor.

At present, the occurrence of delay is avoided by limiting the number ofinput images input to the IP converter reception apparatus 11 andreducing the size of the input images (reducing the resolution).

However, the method of limiting the number of input images input to theIP converter reception apparatus 11 and reducing the size of the inputimages (reducing the resolution) can be said to be a method that recedesagainst measures to multimodality (making multiple different medicalimage data centrally manageable and viewable) and the progress of theimage processing technology that increases the resolution.

Therefore, the IP converter reception apparatus of the presentdisclosure changes a compression rate depending on the type of image sothat the compression rate is high for the types of images that havelittle effect even when the image quality is sacrificed so as tosuppress a reduction in resolution of the image that the surgeryoperator wants to see at a high resolution while accepting an input of agreater number of images.

2. Configuration Example of the Intra-Hospital Image Processing Systemof the Present Disclosure

Next, a configuration example of the intra-hospital image processingsystem of the present disclosure will be described with reference toFIG. 2.

An intra-hospital image processing system 40 of FIG. 2 records andmanages images in a hospital, and combines the recorded and managedimages and images during surgery into a single image and presents theimage to the surgery operator.

More specifically, the intra-hospital image processing system 40includes a camera (Camera) 50, a camera control unit (CCU) 51, an IPconverter transmission apparatus (IPC-Tx) 52, a hub 53, an imagemanagement server 54, an IP converter reception apparatus (IPC-Rx) 55,and a monitor 56.

The camera 50 is an imaging apparatus installed in a surgery room, andis controlled by the CCU 51 and captures, for example, an operativefield image, an endoscopic image, a laparoscopic image, and the like asstream images, and outputs the stream image to the camera control unit(CCU) 51. The camera 50 outputs the captured stream image to the cameracontrol unit (CCU) 51 as an image signal such as YCC/422/10 bit of 3Gbps-serial digital interface (3G-SDI). Note that the scheme of theimage signal is not limited to YCC/422/10 bit of 3G-SDI, but may beother various schemes.

The camera control unit (CCU) 51 controls the operation of the camera 50and outputs the image signal of the stream image captured by the camera50 to the IP converter transmission apparatus (IPC-Tx) 52.

Note that although there is only one camera 50 in FIG. 2, a plurality ofcameras 50 may be provided. Furthermore, instead of the camera 50 andthe camera control unit (CCU) 51, medical equipment capable of supplyingmedical images such as computed tomography (CT) images and magneticresonance imaging (MRI) images may be connected so that medical imagescan be supplied.

The IP converter transmission apparatus (IPC-Tx) 52 encodes the imagesignal constituting the stream image into a stream scheme such as lowlatency video codec (LLVC) and outputs it as an IP-packetized networksignal to the IP converter reception apparatus 55 or the imagemanagement server 54 via the hub 53.

The type of encoding of the stream image may be other than LLVC, and maybe, for example, MPEG-4 Part 10 Advanced Video Coding (H264), JointPhotographic Experts Group 2000 (JPEG2000), Differential Pulse CodeModulation (DPCM), and the like.

The image management server 54 is, for example, an operation room (OR)server provided in the hospital, acquires and stores various types ofimages (so-called multimodality images) such as a computed tomography(CT) image, a magnetic resonance imaging (MRI) image, and an X-rayimage, which are preliminarily captured in the hospital, via the hub 53,and outputs the images to the IP converter reception apparatus 55 viathe hub 53 as needed.

The IP converter reception apparatus 55 processes the images captured bythe camera 50 via the hub 53 and various images supplied from the imagemanagement server 54 into a single image, outputs the image as the imagesignal to the monitor 56, and causes the monitor 56 to display theimage.

With such a configuration, the IP converter reception apparatus 55presents necessary information to the surgery operator by combining CTimages, MRI images, X images, and the like preliminarily captured in thehospital as well as operative field images, endoscopic images,laparoscopic images, and the like into a single image and displaying iton the monitor with respect to the surgery operator. Here, LLVC and H264are visually lossless compression methods, and JPEG2000 and DPCM arelossless compression methods. Therefore, in a case of combining into asingle PinP image, for example, for operative field images, endoscopicimages, laparoscopic images, and the like that are combined as a mainimage, the encoding method may be JPEG2000 or DPCM, and for images thatare sub-images, the encoding method may be LLVC or H264.

3. Configuration Example of the First Embodiment of the IP ConverterReception Apparatus

Next, a configuration example of the first embodiment of the IPconverter reception apparatus (IPC-Rx) 55 of FIG. 2 will be describedwith reference to FIG. 3.

More specifically, the IP converter reception apparatus (IPC-Rx) 55includes an input unit (Network Rx) 71, decoders (Decoder AAA to DecoderZZZ) 72-1 to 72-n, bit packing units (BitPack) 73-1 to 73-n, a bitpacking control unit (PackingCtrl) 74, a table (Table) 75, an expansionbus (peripheral component interconnect express (PCIe)) 76, a graphicsprocessing unit (GPU) 77, and an output unit (serial digital interface(SDI) 78.

The input unit (Network Rx) 71 is an interface that accepts the input ofa plurality of stream images such as operative field images, endoscopicimages, and laparoscopic images that are currently captured in additionto images such as IP-packetized CT images, MRI images, and X-ray images,and outputs a corresponding stream image to the decoders 72-1 to 72-nthat perform decoding by the corresponding type of decoding methodaccording to the type of image.

The decoders (Decoder AAA to Decoder ZZZ) 72-1 to 72-n are decoders eachdecoding the stream images for each type of encoding and outputting thedecoded stream images to the respective bit packing units 73-1 to 73-n.Note that “AAA” to “ZZZ” in “Decoder AAA” to “Decoder ZZZ” in thedrawing indicate that they are decoders corresponding to different typesof encoding.

The bit packing units (BitPack) 73-1 to 73-n, on the basis ofinformation object definition (IOD) data of ancillary data (for example,digital imaging and communications in medicine (DICOM)) in the imagesignal of the decoded stream image, extracts and recognizes the type ofthe image signal, and supplies the type of the image signal to the bitpacking control unit (PackingCtrl) 74.

The bit packing units (BitPack) 73-1 to 73-n compress the image signalby bit packing by a bit packing method specified by the bit packingcontrol unit (PackingCtrl) 74 according to the type of the image signal,and outputs the image signal to the GPU 77 via the expansion bus (PCIe)76.

The bit packing control unit (PackingCtrl) 74 accesses the table (Table)75 that stores information of the bit packing method according to thetype of image signal supplied from each of the bit packing units(BitPack) 73-1 to 73-n, reads the information of the bit packing methodaccording to the type of the image signal, and outputs it to each of thebit packing units (BitPack) 73-1 to 73-n.

The expansion bus (peripheral component interconnect express (PCIe)) 76is a data transmission path from the bit packing units (BitPack) 73-1 to73-n to the GPU 77 and a transmission path from the GPU 77 to the outputunit (serial digital interface (SDI) 78, outputs a plurality of decodedstream images to the GPU 77, and outputs a single PinP image generatedby the GPU 34 to the output unit (SDI-Tx) 78.

The graphics processing unit (GPU) 77 generates a single picture inpicture (PinP) image by image processing that combines a plurality ofimages transmitted via the expansion bus (peripheral componentinterconnect express (PCIe)) 76, and outputs the image to the expansionbus 76.

The output unit (serial digital interface (SDI)-Tx) 78 is a serialinterface that converts the PinP image into a predetermined imagesignal, outputs the image signal to a monitor (Monitor) 56 provided in asurgery room and including a display such as liquid crystal display(LCD) and organic electro luminescence (EL), and causes the monitor todisplay the image.

That is, with the above configuration, for example, in a case where thetype of the supplied image signal is a CT image, the PinP image finallygenerated is a black and white image. Therefore, a bit packing methodthat applies compression so that a Y signal is 10 bits and Cb and Crsignals are 0 bits in the image signal is selected. Furthermore, sincethe operative field image, the endoscopic image, the laparoscopic image,and the like are images desired by the surgery operator to behigh-resolution images, a bit packing method that puts them in anuncompressed state is selected.

In this way, the bit packing method is selected so as to switch betweenthe bit depth of the Y signal and the bit depth of the Cb and Cr signalsaccording to the type of the image signal. Therefore, it is possible toreduce the compression of the band of the expansion bus (PCIe) 76 byreducing the data amount and compressing the types of images that haveno effect even when the image quality is reduced.

As a result, it is possible to suppress a reduction in resolution of animage that a surgery operator wants to see at a high resolution whileresponding to an increase in the number of connections of medicalequipment that supply images.

<Display Control Processing by the IP Converter Reception Apparatus inFIG. 3>

Next, the display control processing by the IP converter receptionapparatus 55 of FIG. 3 will be described with reference to the flowchartof FIG. 4.

In step S11, the input unit (Network Rx) 71 accepts an input of aplurality of types of stream images and outputs them to the decoders72-1 to 72-n that decode the corresponding stream images according tothe type of encoding. The plurality of types of stream images includes,for example, images such as IP-packetized CT images, and MRI imagessupplied from the image management server 54 via the hub 53, andoperative field images, endoscopic images, laparoscopic images, and thelike currently captured by the camera 50 via the CCU 51, the IPconverter (IPC-Tx) 52, and the hub 53.

In step S12, the decoders (Decoder) 72-1 to 72-n decode the types ofstream images for each type of encoding, and output the decoded streamimages to the respective bit packing units 73-1 to 73-n.

In step S13, the bit packing units (BitPack) 73-1 to 73-n each extractand recognize information of the types of individual image signals onthe basis of the ancillary data (DICOM IOD data) in the image signal ofthe decoded stream images, and supplies the information to the bitpacking control unit (PackingCtrl) 74.

In step S14, the bit packing control unit (PackingCtrl) 74 accesses thetable (Table) 75, reads the information of the bit packing methodaccording to the type of the image signal supplied from each of the bitpacking units (BitPack) 73-1 to 73-n, and outputs the information toeach of the bit packing units (BitPack) 73-1 to 73-n.

In step S15, the bit packing units (BitPack) 73-1 to 73-n bit-pack(compress) the image signal by the bit packing method according to thetype of the image signal supplied from the bit packing control unit(PackingCtrl) 74.

In step S16, the bit packing units (BitPack) 73-1 to 73-n output thebit-packed image signal to the GPU 77 via the expansion bus (PCIe) 76.

In step S17, the graphics processing unit (GPU) 77 generates a singlepicture in picture (PinP) image by image processing that combines aplurality of images, and outputs the image to the output unit 78 via theexpansion bus 76.

In step S18, the output unit (serial digital interface (SDI)) 78 outputsthe image signal of the PinP image to the monitor 56 provided in thesurgery room and including the display and causes the monitor to displaythe image.

By the above processing, in the previous stage of the expansion bus(PCIe) 76, the bit packing method is switched according to the type ofthe image signal. For the image signal that has little effect even whenthe image quality is reduced due to a reduction in data amount of theimage signal by compression, the data amount is reduced (compressed) sothat the compression of the band of the expansion bus (PCIe) 76 can besuppressed.

As a result, it is possible to suppress a reduction in resolution of animage that a surgery operator wants to see at a high resolution whileresponding to an increase in the number of connections of medicalequipment that supply images.

Note that the bit packing method may be switched by a method other thanthe method of changing the bit depth of the Y signal and the Cb and Crsignals. For example, according to the type of the image signal, the bitpunking method may be switched to switch the format of components suchas YC444, YC422, and YC420.

In this way, according to the type of image signal, the bit packingmethod is switched by switching the format of components to reduce(compress) the data amount for an image signal that has little effecteven when the image quality is reduced due to a reduction in data amountof the image signal by compression, and it is possible to reduce thecompression of the band of the expansion bus (PCIe) 76.

Furthermore, in the above, an example of adjusting the compression rateby switching the bit packing method has been described. However, in acase of an image signal that is substantially a still image and does notrequire much frame rate, like a CT image, the data amount may be reducedby lowering the frame rate according to the type of image signal basedon the information of DICOM IOD data.

By switching the frame rate according to the type of image signal inthis way, it is possible to reduce the band of the expansion bus (PCIe)76.

Moreover, regarding the bit packing method, it may be possible touniformly switch to the same bit packing method within the frame, or, ina case where it is known that the image is an endoscopic image from aspecific area in the frame, e.g., the DICOM IOD data, a bit packingmethod may be used that greatly reduces the image signal of the areaoutside the mask, which is almost black.

By switching the bit packing method for each area in the frame accordingto the type of the image signal in this way, it is possible to reducethe compression of the band of the expansion bus (PCIe) 76.

In either case, in the previous stage of the expansion bus (PCIe) 76,when the bit packing method for each area in the frame is switched orthe frame rate is switched according to the type of the image signal,for image signals having little effect even when the data amount thereofis reduced, the data amount of the image signal is compressed to bereduced such that the compression of the band of the expansion bus(PCIe) 76 is suppressed.

Moreover, in the above, the bit packing units (BitPack) 73-1 to 73-nextract the type of the image signal on the basis of the ancillary data(DICOM IOD data) in the image signal of the decoded stream image andsupply the type to the bit packing control unit (PackingCtrl) 74, butthe type of image signal may be determined by a method other than DICOMIOD data.

That is, in a case where an image that does not include DICOM IOD datain the image signal is supplied, the bit packing unit (BitPack) 73itself may analyze the image to determine the type of the image signal.For example, an image having a round black mask portion on the outerperiphery may be determined to be an endoscopic image, and a grayscaleimage may be determined to be an X-ray image or a CT image. Furthermore,the type of the image may be determined according to an analysis resultof a spatial frequency analysis or a dynamic range analysis of eachchannel of the Y, Cb, and Cr signals, and the bit packing method may beswitched according to the determination result.

Furthermore, in the above, description is given of the example whereinformation indicating what kind of bit packing method should be used isread from the table 75 and instructions are given to the bit packingunit 73 by the bit packing control unit (PackingCtrl) 74 of the IPconverter reception apparatus 55 according to the type of the imagesignal recognized by the DICOM IOD data or the image analysis.

However, when it is possible to give instructions of the bit packingmethod, a configuration other than the bit packing control unit(PackingCtrl) 74 may give instructions. For example, the imagemanagement server 54 may give instructions as to which bit packingmethod to use according to the type of the image signal. Morespecifically, the image management server 54 may be able to rewrite theinformation of the bit packing method corresponding to the type of theimage signal, which is registered in the table 75, and may functionsimilarly to the bit packing control unit (PackingCtrl) 74 to directlygive an instruction of the bit packing method to the bit packing unit73.

4. Configuration Example of the Second Embodiment of the IP ConverterReception Apparatus

In the above, description is given of the example where the bit packingmethod is switched according to the type of the image signal to reducethe data amount of image signal for an image signal that has littleeffect even when the data amount is reduced such that compression of theband of the expansion bus (PCIe) 76 is suppressed. However, the imagesignal may be encoded and decoded back by the GPU according to the typeof the image signal.

FIG. 5 shows a configuration example of the second embodiment of the IPconverter reception apparatus in which the image signal is encoded anddecoded back by the GPU according to the type of the image signal togenerate a single PinP image. Note that in the IP converter receptionapparatus 55 of FIG. 5, the same reference numerals are given to theconfigurations having the same functions as the configuration of the IPconverter reception apparatus 55 of FIG. 3, and the description thereofwill be omitted as appropriate.

That is, the IP converter reception apparatus 55 of FIG. 5 differs fromthe IP converter reception apparatus 55 of FIG. 3 in that, instead ofthe bit packing units (BitPack) 73-1 to 73-n, the bit packing controlunit (PackingCtrl) 74, the table (Table) 75, and the graphics processingunit (GPU) 77, encoders (Enc) 91-1 to 91-n, a table (Table) 92, and agraphics processing unit (GPU) 93 are provided.

The encoders (Enc) 91-1 to 91-n determine the type of the image signaldecoded by the decoders (Dec) 72-1 to 72-n, read the information of acorresponding encoding method from the table 92 that stores theinformation of encoding methods according to the type of the imagesignal, encodes the image signal by the read encoding method, andoutputs the image signal to the GPU 93 via the expansion bus (PCIe) 76.The encoding method used in the encoder 91 is, for example, losslesscompression JPEG2000, lossless compression DPCM, or the like.

The graphics processing unit (GPU) 93 includes decoders (Dec) 111-1 to111-n that decode the encoded image signal corresponding to each of theencoders (Enc) 91-1 to 91-n, generate a single picture in picture (PinP)image by image processing that combines a plurality of decoded images,and outputs the image to the expansion bus 76.

That is, with the above configuration, for example, an encoding methodis selected according to the type of the supplied image signal, and forimage signals having little effect even when the data amount thereof isreduced, an encoding method that increases the compression rate isselected. Therefore, it is possible to reduce the compression of theband of the expansion bus (PCIe) 76 by reducing the data amount andcompressing the types of images that have no effect even when the imagequality is reduced.

As a result, it is possible to suppress a reduction in resolution of animage that a surgery operator wants to see at a high resolution whileresponding to an increase in the number of connections of medicalequipment that supply images.

<Display Control Processing by the IP Converter Reception Apparatus ofFIG. 5>

Next, the display control processing by an IP converter receptionapparatus of FIG. 5 will be described with reference to the flowchart ofFIG. 6.

In step S31, the input unit (Network Rx) 71 accepts an input of aplurality of types of stream images and outputs them to the decoders72-1 to 72-n that decode the corresponding stream images according tothe type of encoding.

In step S32, the decoders (Decoder) 72-1 to 72-n decode the encodedstream images for each encoding type and output the decoded streamimages to the respective encoders (Enc) 91-1 to 91-n.

In step S33, the encoders (Enc) 91-1 to 91-n extract and recognize theinformation of the type of individual image signal on the basis of theancillary data (DICOM data) in the image signal of the decoded streamimage.

In step S34, the encoders (Enc) 91-1 to 91-n access the table (Table) 92and read information of an encoding method according to the type ofrecognized image signal.

In step S35, the encoders (Enc) 91-1 to 91-n encode the image signal bythe read encoding method.

In step S36, the encoders (Enc) 91-1 to 91-n output the encoded imagesignal to the GPU 93 via the expansion bus (PCIe) 76.

In step S37, the graphics processing unit (GPU) 93 controls each of thedecoders (Dec) 111-1 to 111-n to decode the image signal encoded by amethod corresponding to each of the encoders (Enc) 91-1 to 91-n.

In step S38, the GPU 93 generates a single picture in picture (PinP)image by image processing that combines a plurality of decoded images,and outputs the image to the output unit 78 via the expansion bus 76.

In step S39, the output unit (serial digital interface (SDI)) 78 outputsthe image signal of the PinP image to the monitor 56 provided in thesurgery room and including the display and causes the monitor to displaythe image.

By the above processing, in the previous stage of the expansion bus(PCIe) 76, the encoding method is switched according to the type of theimage signal. For the image signal that has little effect even when theimage quality is reduced due to a reduction in data amount by encodingof the image signal, encoding is performed so that the data amount isreduced (compressed), such that the compression of the band of theexpansion bus (PCIe) 76 can be suppressed.

As a result, it is possible to suppress a reduction in resolution of animage that a surgery operator wants to see at a high resolution whileresponding to an increase in the number of connections of medicalequipment that supply images.

Furthermore, in the above, description is given of the example in whichthe information indicating what kind of encoding method should be usedaccording to the type of the image signal recognized by the DICOM IODdata or image analysis is read from the table 92 by the encoder (Enc) 91of the IP converter reception apparatus 55, and the encoder 91 makesdetermination. However, as long as the encoding method can bedetermined, it may be determined by other than the encoder 91. Forexample, the image management server 54 may give an instruction to theencoder 91 as to which encoding method to use according to the type ofthe image signal.

5. Configuration Example of the Third Embodiment of the IP ConverterReception Apparatus

In the above, description is given of the example in which the bitpacking method or encoding method is switched according to the type ofthe image signal to compress and reduce the data amount for the imagesignal that has little effect even when the data amount of the imagesignal is reduced such that compression of the band of the expansion bus(PCIe) 76 is suppressed. However, the bit packing format may be switchedaccording to the processing load on the GPU.

The GPU is subjected to varying processing loads depending on the formatof data in the image signal processing. That is, in a case of a formatincluding 16-bit alignment, the GPU does not require extra computingresources for reading the data, so that the processing load is reduced.Therefore, even for an image signal that is reduced in base imagequality, it is possible to perform advanced processing for recognitionprocessing or the like.

On the other hand, in a case where band compression is prioritized andthe format is not 16-bit alignment, the GPU will use computing resourcesto read it, resulting in a reduction in image processing that can beperformed.

Therefore, the bit packing format may be switched according to the loadstatus of the GPU.

FIG. 7 shows a configuration example of the third embodiment of the IPconverter reception apparatus in which the bit packing format isswitched according to the load status of the GPU. Note that in the IPconverter reception apparatus 55 of FIG. 7, the same reference numeralsare given to the configurations having the same functions as theconfiguration of the IP converter reception apparatus 55 of FIG. 3, andthe description thereof will be omitted as appropriate.

That is, the IP converter reception apparatus 55 of FIG. 7 differs fromthe IP converter reception apparatus 55 of FIG. 3 in that, instead ofthe bit packing units (BitPack) 73-1 to 73-n, the bit packing controlunit (PackingCtrl) 74, the table (Table) 75, and the graphics processingunit (GPU) 77, bit packing units (BitPack) 131-1 to 131-n, a bit packingcontrol unit (PackingCtrl) 132, and a graphics processing unit (GPU) 133are provided.

The bit packing units (BitPack) 131-1 to 131-n bit-pack the decodedimage signal according to the type of the image signal in a formataccording to the processing load of the GPU 133 supplied from the bitpacking control unit 132, and output the image signal to the GPU 133 viathe expansion bus (PCIe) 76.

The GPU 133 includes a processor 151, and information of the processingload of the processor 151 is read by the bit packing control unit 132.

The bit packing control unit 132 outputs information of the bit packingformat according to the processing load of the processor 151 of the GPU133 to the bit packing units (BitPack) 131-1 to 131-n.

<Bit Packing Format>

Here, with reference to FIG. 8, the bit packing format according to theprocessing load of the processor 151 of the GPU 133 will be described.

Normally, as shown in the upper part of FIG. 8, a Y signal and Cb and Crsignals represented by Y0, Cb01, and Cr01 are each bit-packed in a16-bit aligned 16-bit packing format formed every 16 bits.

Note that, in the upper part of FIG. 8, each of the Y signal and the Cband Cr signals has 6 bits as the remainder bits from the LSB and theremaining 10 bits as the payload.

That is, since each signal is 16-bit aligned, the processor 151 of theGPU 133 that handles floating point numbers reads data in 16-bit units,and because of good data access, data can be read with a low load.

Here, in the case of the 16-bit packing format, since each of the Y, Cb,and Cr signals is 16 bits, the total data amount is 48 bits. Note that,in the upper part of FIG. 8, YCbCr is a component format 422, and eachsignal is data including 10 bits.

For this reason, when all of the images are in the 48-bit data format,the band of the expansion bus (PCIe) 76 will be compressed as the numberof image types increases.

Therefore, two types of bit packing formats shown in the lower part ofFIG. 8 can be considered.

The first bit packing format is a hetero-packing format in which, asshown in the lower left part of FIG. 8, a Y signal represented by Y0 is16 bits, and Cb and Cr signals represented by Cb01 and Cr01 are each 8bits.

In the hetero-packing format in the lower left part of FIG. 8, 6 bitsfrom the LSB of the Y signal represented by Y0 are the remainder bits,the remaining 10 bits are the payload, and Cb and Cr signals representedby Cb01 and Cr01 each have 8 bits as the payload.

In the case of the hetero-packing format in the lower left part of FIG.8, the Y signal is 16 bits without reductions in data amount, and the Cbsignal and Cr signal are each 8 bits to have a total of 16 bits.Therefore, the base image quality is reduced by the reduction in dataamount of the Cb and Cr signals, but because the processing load of theprocessor 151 on the GPU 133 is low, it is possible to perform advancedprocessing for recognition processing or the like.

On the other hand, the second bit packing format is a high compressionpacking format in which, as shown in the lower right part of FIG. 8,each of the Y signal and the Cb and Cr signals is 10 bits.

In the high compression packing format in the lower right part of FIG.8, each of the Y signal and the Cb and Cr signals represented by Y0,Cb01, and Cr01 has 10 bits from the LSB as the payload, and theremaining 2 bits is the remainder bits.

In the case of the high compression packing format in the lower rightpart of FIG. 8, the Y, Cb, and Cr signals are all 10 bits. A reductionin data amount of the Y, Cb, and Cr signals is small as compared to thehetero-packing format, and thus compression has been performed at highefficiency, accordingly, and a reduction in base image quality can besuppressed as compared with the hetero-packing format. However, sincethe format in the lower right part of FIG. 8 is data that is not in16-bit units, the processing load of the processor 151 on the GPU 133related to reading becomes high, so that a lot of resources are requiredto read the data and other advanced processing cannot be performed,accordingly.

Therefore, in a case where the processing load of the processor 151 ofthe GPU 133 is lower than a predetermined threshold value, control isperformed such that bit punking is performed by the high compressionpacking format shown in the middle of FIG. 9 with respect to the 16-bitpacking format in which the compression of the band of the normalexpansion bus (PCIe) 76 shown in the upper part of FIG. 9 is large(indicated as “NG” in the drawing). The high compression packing formatcan reduce the compression of the band on the expansion bus (PCIe) 76(indicated as “OK” in the drawing), but the processing load of theprocessor 151 on the GPU 133 becomes high load (unpack is high load), sothat advanced signal processing by the GPU 133 becomes impossible (GPUsignal processing becomes poor).

On the other hand, in a case where the processing load of the processor151 of the GPU 133 is higher than a predetermined threshold value,control is performed such that bit punking is performed by thehetero-packing format shown in the middle of FIG. 9. The hetero-packingformat can reduce the compression of the band on the expansion bus(PCIe) 76 (indicated as “OK” in the drawing) and enables reading of datain 16-bit units. Therefore, the processing load of the processor 151 onthe GPU 133 becomes low load (unpack is low load), so that advancedsignal processing becomes possible (GPU signal processing becomes rich).

<Display Control Processing by the IP Converter Reception Apparatus ofFIG. 7>

Next, the display control processing by an IP converter receptionapparatus 55 of FIG. 7 will be described with reference to the flowchartof FIG. 10.

In step S61, the input unit (Network Rx) 71 accepts an input of aplurality of types of stream images and outputs them to the decoders72-1 to 72-n that decode the corresponding stream images according tothe type of encoding.

In step S62, the decoders (Decoder) 72-1 to 72-n decode the types ofstream images for each type of encoding, and output the decoded streamimages to the respective bit packing units 131-1 to 131-n.

In step S63, the bit packing control unit (PackingCtrl) 132 reads theload of the processor 151 of the GPU 133.

In step S64, the bit packing control unit (PackingCtrl) 132 determineswhether or not the processing load of the processor 151 of the GPU 133is lower than the predetermined value (threshold value), and in a casewhere it is lower than the predetermined value, the processing proceedsto step S66.

In step S65, the bit packing control unit (PackingCtrl) 132 gives aninstruction to the bit packing units (BitPack) 131-1 to 131-n to performbit packing by the high compression packing format described withreference to the lower right part of FIG. 8.

On the basis of this instruction, the bit packing units (BitPack) 131-1to 131-n bit-pack the image signal by the high compression packingformat.

On the other hand, in step S64, in a case where the processing load ofthe processor 151 of the GPU 133 is not lower than the predeterminedthreshold value, the processing proceeds to step S66.

In step S66, the bit packing control unit (PackingCtrl) 132 gives aninstruction to the bit packing units (BitPack) 131-1 to 131-n to performbit packing by the hetero-packing format described with reference to thelower left part of FIG. 8.

On the basis of this instruction, the bit packing units (BitPack) 131-1to 131-n bit-pack the image signal by the hetero-packing format.

In step S67, the bit packing units (BitPack) 131-1 to 131-n output thebit-packed image signal to the GPU 133 via the expansion bus (PCIe) 76.

In step S68, the graphics processing unit (GPU) 133 generates a singlepicture in picture (PinP) image by image processing that uses aplurality of images, and outputs the image to the output unit 78 via theexpansion bus 76.

In step S69, the output unit (serial digital interface (SDI)) 78 outputsthe image signal of the PinP image to the monitor 56 provided in thesurgery room and including the display and causes the monitor to displaythe image.

Note that, needless to say, in both of the processing of steps S65 andS66, the bit packing units (BitPack) 131-1 to 131-n may switch the bitpacking format according to the processing load of the processor 151 ofthe GPU 133 and may switch the bit packing method according to the typeof the image.

By the above processing, in the previous stage of the expansion bus(PCIe) 76, the bit packing format is switched according to theprocessing load of the GPU, so that for the image signal that has littleeffect even when the data amount of the image signal is reduced, thedata amount is reduced, and it becomes possible to suppress thecompression of the band of the expansion bus (PCIe) 76.

Furthermore, when the processing load of the GPU 133 is low and asufficient processing capacity can be secured, it is possible tosuppress a reduction in image quality due to data by the highcompression bit packing format while suppressing band compression.

Moreover, when the processing load of the GPU 133 is high and asufficient processing capacity cannot be secured, the hetero-bit packingformat allows a reduction in image quality due to data, but it ispossible to suppress an increase in processing load due to the GPU 133.

As a result, it is possible to suppress a reduction in resolution of animage that a surgery operator wants to see at a high resolution whileresponding to an increase in the number of connections of medicalequipment that supply images.

Note that, in the above, the configuration in which the processor 151 inthe GPS 133 controls the bit packing control unit (PackingCtrl) 132 hasbeen described, but a separate processor such as a CPU may be present inthe IPC-Rx 55 and the processor may read the register of the GPU 133 tocontrol the bit packing control unit (PackingCtrl) 132 on the basis ofthe result.

Furthermore, in the above, an example in which the expansion bus 76,which is a data transmission path, is PCIe has been described, but aslong as it functions as a data transmission path, it can be applied toother configurations. For example, it may be applied to mobile industryprocessor interface (MIPI), gigabit multimedia serial link (GMSL), orthe like, which functions as a data transmission path.

Moreover, in the above, an example in which a single PinP image isgenerated by image processing that combines a plurality of types ofimage signals and presented to the surgery operator has been described,but even in the case of a 3D image that presents at least two images forthe left and right eyes, the compression of the band of the expansionbus (PCIe) 76 can be suppressed by similar handling.

With such a configuration, for example, whether or not the monitor 56supports 3D display cannot be recognized by the camera 50 or the imagemanagement server 54 in the hospital. Therefore, image signals for boththe left and right eyes are transmitted to the IP converter receptionapparatus (IPC-Rx) 55.

The IP converter reception apparatus (IPC-Rx) 55 may perform control toswitch the image signals for both the left and right eyes in theprevious stage of the expansion bus (PCIe) 76 according to the displayfunction of the monitor 56 to which the IP converter reception apparatusis connected, to, for example, a Line by Line image (progressive imagesignal), a Top and Bottom image signal (interlaced image signal), or a2D image signal, and output the image signal to the GPU 77.

6. Example of Execution by Software

Incidentally, the series of processing described above can be executedby hardware, but it can also be executed by software. In a case wherethe series of processing is executed by software, a program thatconstitutes the software is installed, from a recording medium, in acomputer incorporated in a dedicated hardware or, for example, in ageneral-purpose computer and the like that can execute various functionswhen various programs are installed.

FIG. 11 shows a configuration example of a general-purpose computer.This personal computer incorporates a central processing unit (CPU)1001. An input/output interface 1005 is connected to the CPU 1001 via abus 1004. A read only memory (ROM) 1002 and a random access memory (RAM)1003 are connected to the bus 1004.

An input unit 1006 including an input device including a keyboard, amouse, or the like with which the user inputs an operation command, anoutput unit 1007 that outputs a processing manipulation screen or animage of processing results to a display device, a storage unit 1008including a hard disk drive or the like storing a program or variousdata, and a communication unit 1009 including a local area network (LAN)adapter or the like and executing communication processing via a networkrepresented by the Internet are connected to the input/output interface1005. Furthermore, a drive 1010 that reads and writes data with respectto a removable storage medium 1011, e.g., a magnetic disk (including aflexible disk), an optical disk (including a compact disc-read onlymemory (CD-ROM), a digital versatile disc (DVD)), a magneto-optical disk(including mini disc (MD)), or a semiconductor memory is connected.

The CPU 1001 executes various processing according to a program storedin the ROM 1002 or a program that is read from the removable storagemedium 1011, e.g., a magnetic disk, an optical disk, a magneto-opticaldisk, or a semiconductor memory, installed in the storage unit 1008, andloaded on the RAM 1003 from the storage unit 1008. Data or the likerequired for the CPU 1001 to execute various processing are also storedin the RAM 1003 as appropriate.

In a computer configured in the aforementioned manner, for example, theCPU 1001 loads a program stored in the storage unit 1008 on the RAM 1003via the input/output interface 1005 and the bus 1004 and executes theprogram, and thus the aforementioned series of processing is carriedout.

The program to be executed by the computer (CPU 1001) can be provided bybeing recorded on the removable storage medium 1011, for example, as apackage medium or the like. Furthermore, the program can be provided viaa wired or wireless transmission medium such as a local area network,the Internet, or digital satellite broadcasting.

In the computer, the program can be installed in the storage unit 1008via the input/output interface 1005 when the removable storage medium1011 is mounted on the drive 1010. Furthermore, the program can bereceived by the communication unit 1009 via a wired or wirelesstransmission medium and installed in the storage unit 1008. In addition,the program can be pre-installed in the ROM 1002 or the storage unit1008.

Note that the program executed by the computer may be a program that isprocessed in chronological order along the order described in thepresent description or may be a program that is processed in parallel orat a required timing, e.g., when call is carried out.

Note that the CPU 1001 in FIG. 11 realizes functions of the decoders72-1 to 72-n, the bit packing units 73-1 to 73-n, the bit packingcontrol unit 74 of FIG. 3, the encoders 91-1 to 91-n of FIG. 5, or thedecoders 72-1 to 72-n, the bit packing units 131-1 to 131-n, and the bitpacking control unit 132 of FIG. 7.

Furthermore, in the present description, the system means a cluster of aplurality of constituent elements (an apparatus, a module (component),or the like), and it does not matter whether or not all the constituentelements are present in the same enclosure. Therefore, a plurality ofapparatuses that is housed in different enclosures and connected via anetwork, and a single apparatus in which a plurality of modules ishoused in a single enclosure are both the system.

Note that an embodiment of the present disclosure is not limited to theaforementioned embodiments, and various changes may be made within ascope without departing from the gist of the present disclosure.

For example, the present disclosure can adopt a configuration of cloudcomputing in which one function is shared and jointly processed by aplurality of apparatuses via a network.

Furthermore, each step described in the above-described flowcharts canbe executed by a single apparatus or shared and executed by a pluralityof apparatuses.

Moreover, in a case where a single step includes a plurality of piecesof processing, the plurality of pieces of processing included in thesingle step can be executed by a single apparatus or can be shared andexecuted by a plurality of apparatuses.

7. Application Example

The technology according to the present disclosure is applicable to avariety of products. For example, the technology according to thepresent disclosure may be applied to a surgery room system.

FIG. 12 is a diagram schematically showing the overall configuration ofa surgery room system 5100 to which the technology according to thepresent disclosure can be applied. With reference to FIG. 12, thesurgery room system 5100 is configured such that an apparatus groupinstalled in a surgery room is connected to be capable of cooperatingwith each other through an audiovisual controller (AV controller) 5107and a surgery room control apparatus 5109.

In the surgery room, various apparatuses can be provided. In FIG. 12, asan example, various apparatus groups 5101 for an endoscopic surgery, aceiling camera 5187 which is disposed on the ceiling of the surgeryroom, and images the hands of a surgery operator, a surgery site camera5189 which is disposed on the ceiling of the surgery room, and imagesthe entire state of the surgery room, a plurality of display apparatuses5103A to 5103D, a recorder 5105, a patient bed 5183, and an illumination5191, are shown.

Here, among these apparatuses, the apparatus group 5101 belongs to anendoscope surgery system 5113 as described later, and includes anendoscope, a display apparatus displaying an image imaged by theendoscope, and the like. Each of the apparatuses belonging to theendoscope surgery system 5113 is also referred to as medical equipment.On the other hand, the display apparatuses 5103A to 5103D, the recorder5105, the patient bed 5183, and the illumination 5191, for example, areapparatuses provided in the surgery room, separately from the endoscopesurgery system 5113. Each of the apparatuses not belonging to theendoscope surgery system 5113, is also referred to as non-medicalequipment. The audiovisual controller 5107 and/or the surgery roomcontrol apparatus 5109 cooperatively control the operation of themedical equipment and the non-medical equipment.

The audiovisual controller 5107 integrally controls processing relevantto image display in the medical equipment and the non-medical equipment.Specifically, in the apparatuses of the surgery room system 5100, theapparatus group 5101, the ceiling camera 5187, and the surgery sitecamera 5189 can be an apparatus having a function of transmittinginformation to be displayed during the surgery (hereinafter, alsoreferred to as display information) (hereinafter, also referred to as anapparatus of a transmission source). Furthermore, the displayapparatuses 5103A to 5103D can be an apparatus to which the displayinformation is output (hereinafter, also referred to as an apparatus ofan output destination). Furthermore, the recorder 5105 can be anapparatus corresponding to both of the apparatus of the transmissionsource and the apparatus of the output destination. The audiovisualcontroller 5107 has a function of controlling the operation of theapparatus of the transmission source and the apparatus of the outputdestination, of acquiring the display information from the apparatus ofthe transmission source, of transmitting the display information to theapparatus of the output destination, and of causing the displayinformation to be displayed or recorded. Note that the displayinformation is various images imaged during the surgery, variousinformation associated with the surgery (for example, body informationof a patient, a test result of the past, information associated with asurgery method, or the like), and the like.

Specifically, information with respect to an image of a surgery portionin body cavity of the patient, which is imaged by the endoscope, can betransmitted to the audiovisual controller 5107 from the apparatus group5101, as the display information. Furthermore, information with respectto an image of the hands of the surgery operator, which is imaged by theceiling camera 5187, can be transmitted from the ceiling camera 5187, asthe display information. Furthermore, information with respect to animage indicating the entire state of the surgery room, which is imagedby the surgery site camera 5189, can be transmitted from the surgerysite camera 5189, as the display information. Note that in a case wherethe other apparatus having an imaging function exists in the surgeryroom system 5100, the audiovisual controller 5107 may acquireinformation with respect to an image imaged by the other apparatus fromthe other apparatus, as the display information.

Alternatively, for example, in the recorder 5105, the information withrespect to the image imaged in the past is recorded by the audiovisualcontroller 5107. The audiovisual controller 5107 is capable of acquiringthe information with respect to the image imaged in the past, from therecorder 5105, as the display information. Note that, in the recorder5105, various information associated with the surgery may be alsorecorded in advance.

The audiovisual controller 5107 displays the acquired displayinformation (i.e., an image captured during the surgery or variousinformation associated with the surgery) on at least one of the displayapparatuses 5103A to 5103D, which are the apparatus of the outputdestination. In the shown example, the display apparatus 5103A is adisplay apparatus disposed to be suspended from the ceiling of thesurgery room, the display apparatus 5103B is a display apparatusdisposed on a wall surface of the surgery room, the display apparatus5103C is a display apparatus disposed on a desk in the surgery room, andthe display apparatus 5103D is mobile equipment having a displayfunction (for example, a tablet personal computer (PC)).

Furthermore, even though it is not shown in FIG. 12, the surgery roomsystem 5100 may include an apparatus outside the surgery room. Theapparatus outside the surgery room, for example, can be a serverconnected to a network constructed inside or outside the hospital, or aPC used by a medical staff, a projector disposed in an assembly room ofthe hospital, and the like. In a case where such an external apparatusis outside the hospital, the audiovisual controller 5107 is capable ofdisplaying the display information on a display apparatus of the otherhospital through a teleconference system or the like, in order for aremote medical care.

The surgery room control apparatus 5109 integrally controls processingother than the processing relevant to the image display in thenon-medical equipment. For example, the surgery room control apparatus5109 controls the driving of the patient bed 5183, the ceiling camera5187, the surgery site camera 5189, and the illumination 5191.

An IP converter apparatus (IPC) 5110 is an apparatus that accepts inputof a plurality of IP-packetized images corresponding to the displayinformation transmitted from the transmission source apparatus andoutput from the audiovisual controller 5107, performs decoding for eachimage type, and converts the image into an image signal. At this time, aplurality of images may be combined to generate a single PinP image. TheIP converter apparatus 5110 outputs an image signal to a centralizedmanipulation panel 5111 and causes the centralized manipulation panel5111 to display it. Note that the IP converter apparatus 5110 may have afunction of converting an image signal output from a display device intoan IP packet.

In the surgery room system 5100, a centralized manipulation panel 5111is provided. A user is capable of giving an instruction with respect tothe image display, to the audiovisual controller 5107, or of giving aninstruction regarding the operation of the non-medical equipment, to thesurgery room control apparatus 5109, through the centralizedmanipulation panel 5111. The centralized manipulation panel 5111 has aconfiguration in which a touch panel is disposed on a display surface ofthe display apparatus.

FIG. 13 is a diagram showing a display example of a manipulation screenof the centralized manipulation panel 5111. In FIG. 13, as an example, amanipulation screen corresponding to a case where two displayapparatuses are provided in the surgery room system 5100, as theapparatus of the output destination, is shown. With reference to FIG.13, in the manipulation screen 5193, a transmission source selectionregion 5195, a preview region 5197, and a control region 5201 areprovided.

On the transmission source selection region 5195, a transmission sourceapparatus provided in the surgery room system 5100, and a thumbnailscreen indicating display information of the transmission sourceapparatus, are displayed to be linked to each other. The user is capableof selecting the display information that he/she wants to display on thedisplay apparatus, from any transmission source apparatus displayed onthe transmission source selection region 5195.

On the preview region 5197, a preview of a screen to be displayed on twodisplay apparatuses (Monitor 1 and Monitor 2), which are the apparatusof the output destination, is displayed. In the shown example, fourimages are PinP-displayed on one display apparatus. The four imagescorrespond to the display information transmitted from the transmissionsource apparatus selected in the transmission source selection region5195. Among the four images, one image is displayed comparatively largeas a main image, and the remaining three images are displayedcomparatively small as a sub-image. The user suitably selects an area onwhich four images are displayed, and thus is capable of switchingbetween the main image and the sub-image. Furthermore, in a lowerportion of the area on which four images are displayed, a status displayregion 5199 is provided. A status relevant to the surgery (for example,an elapsed time of the surgery, the body information of the patient, andthe like) can be suitably displayed on the area.

In the control region 5201, a transmission source manipulation region5203 on which a graphical user interface (GUI) component for performinga manipulation with respect to the apparatus of the transmission source,is displayed, and an output destination manipulation region 5205 onwhich a GUI component for performing a manipulation with respect to theapparatus of the output destination, is displayed, are provided. In theshown example, in the transmission source manipulation region 5203, aGUI component for performing various manipulations (pan, tilt, and zoom)with respect to a camera in the apparatus of the transmission sourcehaving an imaging function, is provided. The user suitably selects theGUI component, and thus, is capable of manipulating the operation of thecamera in the apparatus of the transmission source. Note that, eventhough it is not shown in the drawing, in a case where the apparatus ofthe transmission source selected in the transmission source selectionregion 5195 is a recorder (i.e., in a case where the image recorded inthe recorder in the past is displayed on the preview region 5197), inthe transmission source manipulation region 5203, a GUI component forperforming a manipulation such as reproducing, stopping reproducing,rewinding, and fast forwarding of the image, can be provided.

Furthermore, in the output destination manipulation region 5205, a GUIcomponent for performing various manipulations (swap, flip, toneadjustment, contrast adjustment, and switching between 2D display and 3Ddisplay) with respect to the display on the display apparatus, which isthe apparatus of the output destination, is provided. The user suitablyselects such a GUI component, and thus, is capable of manipulating thedisplay on the display apparatus.

Note that the manipulation screen to be displayed on the centralizedmanipulation panel 5111 is not limited to the shown example, and theuser may perform manipulation input with respect to each apparatus,which is provided in the surgery room system 5100, and is capable ofbeing controlled by the audiovisual controller 5107 and the surgery roomcontrol apparatus 5109, through the centralized manipulation panel 5111.

FIG. 13 is a diagram showing an example of the state of the surgery towhich the surgery room system described above is applied. The ceilingcamera 5187 and the surgery site camera 5189 are disposed on the ceilingof the surgery room, and are capable of capturing the hands of a surgeryoperator (a surgeon) 5181 performing a treatment with respect to anaffected part of a patient 5185 on the patient bed 5183, and the entirestate of the surgery room. In the ceiling camera 5187 and the surgerysite camera 5189, a magnification adjustment function, a focal pointdistance adjustment function, a capturing direction adjustment function,and the like can be provided. The illumination 5191 is disposed on theceiling of the surgery room, and irradiates at least the hands of thesurgery operator 5181 with light. The illumination 5191 may suitablyadjust an irradiation light amount, a wavelength (a color) ofirradiation light, a light irradiation direction, and the like.

As shown in FIG. 12, the endoscope surgery system 5113, the patient bed5183, the ceiling camera 5187, the surgery site camera 5189, and theillumination 5191 are connected to be capable of cooperating with eachother, through the audiovisual controller 5107 and the surgery roomcontrol apparatus 5109 (not shown in FIG. 14). In the surgery room, thecentralized manipulation panel 5111 is provided, and as described above,the user is capable of suitably manipulating these apparatuses existingin the surgery room, through the centralized manipulation panel 5111.

Hereinafter, the configuration of the endoscope surgery system 5113 willbe described in detail. As shown in the drawing, the endoscope surgerysystem 5113 includes an endoscope 5115, other surgical tools 5131, asupport arm apparatus 5141 supporting the endoscope 5115, and a cart5151 on which various apparatuses for an endoscopic surgery are mounted.

In the endoscope surgery, a plurality of tubular perforating toolsreferred to as trocars 5139 a to 5139 d, is punctured on an abdominalwall, instead of performing laparotomy by cutting the abdominal wall.Then, a lens tube 5117 of the endoscope 5115, and the other surgicaltools 5131 are inserted into the body cavity of the patient 5185, fromthe trocars 5139 a to 5139 d. In the shown example, as the othersurgical tools 5131, a pneumoperitoneum tube 5133, an energy treatmenttool 5135, and forceps 5137 are inserted into the body cavity of thepatient 5185. Furthermore, the energy treatment tool 5135 is a treatmenttool performing incision and ablation of a tissue, sealing of a bloodvessel, and the like, by a high frequency current or an ultrasonicvibration. Here, the shown surgical tool 5131 is merely an example, andfor example, various surgical tools generally used in the endoscopicsurgery, such as tweezers and a retractor, may be used as the surgicaltool 5131.

The image of the surgery portion in the body cavity of the patient 5185,captured by the endoscope 5115, is displayed on the display apparatus5155. The surgery operator 5181, for example, performs a treatment suchas excision of the affected part by using the energy treatment tool 5135or the forceps 5137, while observing the image of the surgery portiondisplayed on the display apparatus 5155 in real time. Note that, eventhough it is not shown in the drawing, the pneumoperitoneum tube 5133,the energy treatment tool 5135, and the forceps 5137 are supported bythe surgery operator 5181, an assistant, or the like, during thesurgery.

(Support Arm Apparatus)

The support arm apparatus 5141 includes an arm portion 5145 extendingfrom a base portion 5143. In the shown example, the arm portion 5145includes joint portions 5147 a, 5147 b, and 5147 c, and links 5149 a and5149 b, and is driven according to the control from the arm controlapparatus 5159. The endoscope 5115 is supported by the arm portion 5145,and the position and the posture thereof are controlled. Therefore, astable position of the endoscope 5115 can be fixed.

(Endoscope)

The endoscope 5115 includes a lens tube 5117 in which an area of apredetermined length from a tip end, is inserted into the body cavity ofthe patient 5185, and a camera head 5119 connected to a base end of thelens tube 5117. In the shown example, the endoscope 5115 configured as aso-called rigid scope including a rigid lens tube 5117, is shown, butthe endoscope 5115 may be configured as a so-called flexible scopeincluding a flexible lens tube 5117.

An opening portion into which an objective lens is fitted, is providedat the tip end of the lens tube 5117. A light source apparatus 5157 isconnected to the endoscope 5115, and light generated by the light sourceapparatus 5157 is guided to the tip end of the lens tube by a lightguide provided to extend in the lens tube 5117, and is applied towardsan observation target in the body cavity of the patient 5185 through theobjective lens. Note that the endoscope 5115 may be a forward-viewingendoscope, or may be an oblique-viewing endoscope or a side-viewingendoscope.

In the camera head 5119, an optical system and an imaging element areprovided, and reflection light (observation light) from the observationtarget, is condensed in the imaging element by the optical system. Theobservation light is subjected to the photoelectric conversion by theimaging element, and an electrical signal corresponding to theobservation light, that is, an image signal corresponding to anobservation image, is generated. The image signal is transmitted to acamera control unit (CCU) 5153, as RAW data. Note that in the camerahead 5119, a function of adjusting a magnification and a focal pointdistance by suitably driving the optical system, is provided.

Note that, for example, a plurality of imaging elements may be providedin the camera head 5119, in order to correspond to a stereoscopic view(3D display) or the like. In this case, a plurality of relay opticalsystems is provided in the lens tube 5117, in order to guide theobservation light to each of the plurality of imaging elements.

(Various Apparatuses Mounted on Cart)

The CCU 5153 includes a central processing unit (CPU), a graphicsprocessing unit (GPU), or the like, and integrally controls theoperation of the endoscope 5115 and the display apparatus 5155.Specifically, the CCU 5153 performs, on the image signal received fromthe camera head 5119, various image processing for displaying the imagebased on the image signal, such as development processing (demosaicprocessing), for example. The CCU 5153 provides the image signalsubjected to the image processing, to the display apparatus 5155.Furthermore, the audiovisual controller 5107 shown in FIG. 12, isconnected to the CCU 5153. The CCU 5153 also provides the image signalsubjected to the image processing, to the audiovisual controller 5107.Furthermore, the CCU 5153 transmits a control signal to the camera head5119, and controls the driving thereof. The control signal is capable ofincluding information associated with an imaging condition such as amagnification or a focal point distance. The information associated withthe imaging condition may be input through an input apparatus 5161, ormay be input through the centralized manipulation panel 5111 describedabove.

The display apparatus 5155 displays an image based on the image signalsubjected to the image processing by the CCU 5153, according to thecontrol from the CCU 5153. In a case where the endoscope 5115, forexample, corresponds to high-definition capturing such as 4K (the numberof horizontal pixels of 3840×the number of vertical pixels of 2160) or8K (the number of horizontal pixels of 7680×the number of verticalpixels of 4320), and/or corresponds to 3D display, a display apparatuscapable of performing high-definition display corresponding to each of4K and 8K, and/or a display apparatus capable of performing 3D display,can be used as the display apparatus 5155. In the case of correspondingto the high-definition capturing such as 4K or 8K, a display apparatushaving a size of greater than or equal to 55 inches is used as thedisplay apparatus 5155, and thus, more immersion feeling can beobtained. Furthermore, a plurality of display apparatuses 5155 havingdifferent definitions and sizes may be provided, according to a useapplication.

The light source apparatus 5157, for example, includes a light sourcesuch as a light emitting diode (LED), and supplies the irradiation lightat the time of capturing the surgery portion, to the endoscope 5115.

The arm control apparatus 5159, for example, includes a processor suchas a CPU, and is operated according to a predetermined program, andthus, controls the driving of the arm portion 5145 of the support armapparatus 5141, according to a predetermined control method.

The input apparatus 5161 is an input interface with respect to theendoscope surgery system 5113. The user is capable of performing theinput of various information, or the input of an instruction withrespect to endoscope surgery system 5113, through the input apparatus5161. For example, the user inputs various information associated withthe surgery, such as the body information of the patient, and theinformation associated with the surgery method of the surgery, throughthe input apparatus 5161. Furthermore, for example, the user inputs aninstruction of driving the arm portion 5145, an instruction of changingthe imaging condition of the endoscope 5115 (the type of irradiationlight, the magnification, the focal point distance, and the like), aninstruction of driving the energy treatment tool 5135, and the like,through the input apparatus 5161.

The type of input apparatus 5161 is not limited, and the input apparatus5161 may be various known input apparatuses. For example, a mouse, akeyboard, a touch panel, a switch, a foot switch 5171 a lever, and/orthe like can be applied as the input apparatus 5161. In a case where thetouch panel is used as the input apparatus 5161, the touch panel may bedisposed on the display surface of the display apparatus 5155.

Alternatively, the input apparatus 5161, for example, is a devicemounted on the user, such as a glasses type wearable device or a headmounted display (HMD), and various inputs are performed according to thegesture or a line-of-sight of the user, which is detected by such adevice. Furthermore, the input apparatus 5161 includes a camera capableof detecting the motion of the user, and various inputs are performedaccording to the gesture or the line-of-sight of the user detected froma video captured by the camera. Moreover, the input apparatus 5161includes a microphone capable of picking up the voice of the user, andvarious inputs are performed according to the sound through themicrophone. The input apparatus 5161 is configured as described abovesuch that various information can be input in a non-contact manner, andthus, in particular, a user belonging to a clean area (for example, thesurgery operator 5181) is capable of manipulating the equipmentbelonging to an unclean area, in a non-contact manner. Furthermore, theuser is capable of manipulating the equipment without releasing thehands from the possessed surgical tool, and thus, convenience of theuser is improved.

The treatment tool control apparatus 5163 controls the driving of theenergy treatment tool 5135 for the cauterization and the incision of thetissue, the sealing of the blood vessel, or the like. In order to ensurea visual field of the endoscope 5115 and to ensure a working space ofthe surgery operator, the pneumoperitoneum apparatus 5165 sends gas intothe body cavity through the pneumoperitoneum tube 5133 such that thebody cavity of the patient 5185 is inflated. The recorder 5167 is anapparatus capable of recording various information associated with thesurgery. The printer 5169 is an apparatus capable of printing variousinformation associated with the surgery, in various formats such as atext, an image, or a graph.

Hereinafter, in the endoscope surgery system 5113, a particularlycharacteristic configuration will be described in more detail.

(Support Arm Apparatus)

The support arm apparatus 5141 includes the base portion 5143 which is abase, and the arm portion 5145 extending from the base portion 5143. Inthe shown example, the arm portion 5145 includes the plurality of jointportions 5147 a, 5147 b, and 5147 c, and the plurality of links 5149 aand 5149 b joined by the joint portion 5147 b, but in FIG. 14, for thesake of simplicity, the configuration of the arm portion 5145 is simplyshown. Actually, the shape of the joint portions 5147 a to 5147 c andthe links 5149 a and 5149 b, the number of joint portions 5147 a to 5147c and links 5149 a and 5149 b, the arrangement of the joint portions5147 a to 5147 c and the links 5149 a and 5149 b, a rotation axisdirection of the joint portions 5147 a to 5147 c, and the like aresuitably set such that the arm portion 5145 has a desired freedomdegree. For example, the arm portion 5145 can preferably have a freedomdegree of greater than or equal to six. Therefore, the endoscope 5115can be freely moved within a movement range of the arm portion 5145, andthus, it is possible to insert the lens tube 5117 of the endoscope 5115into the body cavity of the patient 5185 from a desired direction.

In the joint portions 5147 a to 5147 c, an actuator is provided, and thejoint portions 5147 a to 5147 c can be rotated around a predeterminedrotation axis by driving the actuator. The driving of the actuator iscontrolled by the arm control apparatus 5159, and thus, a rotation angleof each of the joint portions 5147 a to 5147 c is controlled, and thedriving of the arm portion 5145 is controlled. Therefore, the positionand the posture of the endoscope 5115 can be controlled. At this time,the arm control apparatus 5159 is capable of controlling the driving ofthe arm portion 5145, according to various known control methods such asforce control or position control.

For example, the surgery operator 5181 performs suitable manipulationinput through the input apparatus 5161 (including the foot switch 5171),and thus, the driving of the arm portion 5145 may be suitably controlledby the arm control apparatus 5159, according to the manipulation input,and the position and the posture of the endoscope 5115 may becontrolled. According to the control, the endoscope 5115 at the tip endof the arm portion 5145 can be moved to an arbitrary position from anarbitrary position, and then, can be fixedly supported in the positionafter the movement. Note that the arm portion 5145 may be manipulated bya so-called master-slave system. In this case, the arm portion 5145 canbe remotely manipulated by the user, through the input apparatus 5161provided in a location apart from the surgery room.

Furthermore, in a case where the force control is applied, so-calledpower assist control may be performed, in which the arm controlapparatus 5159 receives an external force from the user, and drives theactuator of each of the joint portions 5147 a to 5147 c such that thearm portion 5145 is smoothly moved according to the external force.Therefore, when the user moves the arm portion 5145 while directlytouching the arm portion 5145, it is possible to move the arm portion5145 with a comparatively light force. Accordingly, it is possible tomore intuitively move the endoscope 5115 by a simpler manipulation, andto improve the convenience of the user.

Here, in general, in the endoscopic surgery, the endoscope 5115 issupported by a medical doctor referred to as a scopist. In contrast, theposition of the endoscope 5115 can be more reliably fixed by using thesupport arm apparatus 5141, without manual work, and thus, it ispossible to stably obtain the image of the surgery portion, and tosmoothly perform the surgery.

Note that the arm control apparatus 5159 may not be necessarily providedin the cart 5151. Furthermore, the arm control apparatus 5159 may not benecessarily one apparatus. For example, the arm control apparatus 5159may be provided in each of the joint portions 5147 a to 5147 c of thearm portion 5145 of the support arm apparatus 5141, and a plurality ofarm control apparatuses 5159 may cooperate with each other, and thus,the driving control of the arm portion 5145 may be realized.

(Light Source Apparatus)

The light source apparatus 5157 supplies the irradiation light at thetime of capturing the surgery portion, to the endoscope 5115. The lightsource apparatus 5157 includes a white light source including, forexample, an LED, a laser light source, or a combination thereof. At thistime, in a case where the white light source includes a combination ofRGB laser light sources, it is possible to control an output intensityand an output timing of each color (each wavelength) with a highaccuracy, and thus, it is possible to adjust a white balance of thecaptured image in the light source apparatus 5157. Furthermore, in thiscase, laser light from each of the RGB laser light sources is applied tothe observation target in time division, and the driving of the imagingelement of the camera head 5119 is controlled in synchronization withthe irradiation timing, and thus, it is also possible to capture animage corresponding to each of RGB in time division. According to such amethod, it is possible to obtain a color image without providing a colorfilter in the imaging element.

Furthermore, the driving of the light source apparatus 5157 may becontrolled such that the intensity of the light to be output is changedfor each predetermined time. The driving of the imaging element of thecamera head 5119 is controlled in synchronization with a timing when theintensity of the light is changed to acquire images in a time divisionmanner, and the images are combined It is thus possible to generate animage of a high dynamic range, without so-called black defects andoverexposure.

Furthermore, the light source apparatus 5157 may be configured to supplylight of a predetermined wavelength band corresponding to special lightimaging. In the special light imaging, for example, light with anarrower band is applied, compared to irradiation light at the time ofperforming usual observation by using wavelength dependency of absorbinglight in the body tissue (i.e., white light), and thus, so-called narrowband imaging of capturing a predetermined tissue of a blood vessel orthe like in a superficial portion of a mucous membrane with a highcontrast, is performed. Alternatively, in the special light imaging,fluorescent light imaging of obtaining an image by fluorescent lightgenerated by being irradiated with excited light, may be performed. Inthe fluorescent light imaging, for example, the body tissue isirradiated with the excited light, and the fluorescent light from thebody tissue is observed (autofluorescent light imaging), or a reagentsuch as indocyanine green (ICG) is locally injected into the bodytissue, and the body tissue is irradiated with excited lightcorresponding to a fluorescent light wavelength of the reagent, andthus, a fluorescent image is obtained. The light source apparatus 5157can be configured to supply the narrow band light and/or the excitedlight corresponding to such special light imaging.

(Camera Head and CCU)

The function of the camera head 5119 and the CCU 5153 of the endoscope5115 will be described in more detail, with reference to FIG. 15. FIG.15 is a block diagram showing an example of a functional configurationof the camera head 5119 and the CCU 5153 shown in FIG. 14.

With reference to FIG. 15, the camera head 5119 includes a lens unit5121, an imaging unit 5123, a driving unit 5125, a communication unit5127, and a camera head control unit 5129, as the function thereof.Furthermore, the CCU 5153 includes a communication unit 5173, an imageprocessing unit 5175, and a control unit 5177, as the function thereof.The camera head 5119 and the CCU 5153 are connected to be capable ofbidirectionally communicating with each other through a transmissioncable 5179.

First, the functional configuration of the camera head 5119 will bedescribed. The lens unit 5121 is an optical system provided in aconnection portion with the lens tube 5117. Observation lightincorporated from a tip end of the lens tube 5117, is guided to thecamera head 5119, and is incident on the lens unit 5121. The lens unit5121 includes a combination of a plurality of lenses including a zoomlens and a focus lens. Optical characteristics of the lens unit 5121 areadjusted such that the observation light is condensed on a lightreceiving surface of an imaging element of the imaging unit 5123.Furthermore, the zoom lens and the focus lens are configured such thatthe positions of the zoom lens and the focus lens on an optical axis canbe moved in order to adjust the magnification and a focal point of thecaptured image.

The imaging unit 5123 includes an imaging element, and is arranged onthe later stage of the lens unit 5121. The observation light passingthrough the lens unit 5121, is condensed on the light receiving surfaceof the imaging element, and an image signal corresponding to theobservation image is generated by the photoelectric conversion. Theimage signal generated by the imaging unit 5123, is provided to thecommunication unit 5127.

For example, a complementary metal oxide semiconductor (CMOS) type imagesensor, which is capable of performing color capturing having a Bayerarray, is used as the imaging element configuring the imaging unit 5123.Note that, for example, an element capable of corresponding tohigh-definition image capturing of greater than or equal to 4K, may beused as the imaging element. The image of the surgery portion isobtained with a high definition, and thus, the surgery operator 5181 iscapable of more specifically grasping the state of the surgery portion,and the surgery can be progressed more smoothly.

Furthermore, the imaging element configuring the imaging unit 5123includes a pair of imaging elements for acquiring each of an imagesignal for a right eye and an image signal for a left eye, correspondingto the 3D display. The 3D display is performed, and thus, the surgeryoperator 5181 is capable of more accurately grasping the depth of thebiological tissue in the surgery portion. Note that, in a case where theimaging unit 5123 has a multi-plate type configuration, a plurality oflens units 5121 is provided corresponding to each of the imagingelements.

Furthermore, the imaging unit 5123 may not be necessarily provided inthe camera head 5119. For example, the imaging unit 5123 may be providedimmediately after the objective lens, in the lens tube 5117.

The driving unit 5125 includes an actuator, and moves the zoom lens andthe focus lens of the lens unit 5121 along the optical axis by apredetermined distance, according to the control from the camera headcontrol unit 5129. Therefore, it is possible to suitably adjust themagnification and the focal point of the image captured by the imagingunit 5123.

The communication unit 5127 includes a communication apparatus fortransmitting and receiving various information with respect to the CCU5153. The communication unit 5127 transmits the image signal obtainedfrom the imaging unit 5123 to the CCU 5153 through the transmissioncable 5179, as the RAW data. At this time, in order to display thecaptured image of the surgery portion with a low latency, it ispreferable that the image signal be transmitted through opticalcommunication. This is because at the time of the surgery, the surgeryoperator 5181 performs the surgery while observing the state of theaffected part with the captured image, and thus, in order for a moresecure and reliable surgery, a moving image of the surgery portion isrequired to be displayed in real time to the maximum extent. In a casewhere the optical communication is performed, in the communication unit5127, a photoelectric conversion module converting an electrical signalinto an optical signal, is provided. The image signal is converted intothe optical signal by the photoelectric conversion module, and then, istransmitted to the CCU 5153 through the transmission cable 5179.

Furthermore, the communication unit 5127 receives a control signal forcontrolling the driving of the camera head 5119, from the CCU 5153. Thecontrol signal, for example, includes information associated with theimaging condition, such as information of designating a frame rate ofthe captured image, information of designating an exposure value at thetime of the imaging, and/or information of designating the magnificationand the focal point of the captured image. The communication unit 5127provides the received control signal to the camera head control unit5129. Note that the control signal from the CCU 5153 also may betransmitted through the optical communication. In this case, in thecommunication unit 5127, a photoelectric conversion module convertingthe optical signal into an electrical signal, is provided, and thecontrol signal is converted into the electrical signal by thephotoelectric conversion module, and then, is provided to the camerahead control unit 5129.

Note that the imaging condition such as the frame rate, the exposurevalue, the magnification, and the focal point, described above, isautomatically set by the control unit 5177 of the CCU 5153, on the basisof the acquired image signal. That is, a so-called auto exposure (AE)function, an auto focus (AF) function, and an auto white balance (AWB)function are provided in the endoscope 5115.

The camera head control unit 5129 controls the driving of the camerahead 5119, on the basis of the control signal from the CCU 5153 receivedthrough the communication unit 5127. For example, the camera headcontrol unit 5129 controls the driving of the imaging element of theimaging unit 5123, on the basis of the information of designating theframe rate of the captured image and/or the information of designatingthe exposure at the time of the imaging. Furthermore, for example, thecamera head control unit 5129 suitably moves the zoom lens and the focuslens of the lens unit 5121 through the driving unit 5125, on the basisof the information of designating the magnification and the focal pointof the captured image. Moreover, the camera head control unit 5129 mayhave a function of storing information for identifying the lens tube5117 or the camera head 5119.

Note that the lens unit 5121, the imaging unit 5123, and the like arearranged in a sealed structure having high airtightness and waterproofproperties, and thus, it is possible for the camera head 5119 to haveresistance with respect to an autoclave sterilization treatment.

Next, the functional configuration of the CCU 5153 will be described.The communication unit 5173 includes a communication apparatus fortransmitting and receiving various information with respect to thecamera head 5119. The communication unit 5173 receives the image signalto be transmitted from the camera head 5119, through the transmissioncable 5179. At this time, as described above, the image signal can bepreferably transmitted through optical communication. In this case, inthe communication unit 5173, a photoelectric conversion moduleconverting an optical signal into an electrical signal, is providedcorresponding to the optical communication. The communication unit 5173provides the image signal converted into the electrical signal, to theimage processing unit 5175.

Furthermore, the communication unit 5173 transmits the control signalfor controlling the driving of the camera head 5119, to the camera head5119. The control signal also may be transmitted through the opticalcommunication.

The image processing unit 5175 performs various image processing on theimage signal which is the RAW data transmitted from the camera head5119. For example, various known signal processing such as developmentprocessing, high-image quality processing (band emphasizing processing,super-resolution processing, noise reduction (NR) processing and/orshake correction processing, or the like), and/or magnificationprocessing (electron zoom processing), are included as the imageprocessing. Furthermore, the image processing unit 5175 performsdetection processing on the image signal, in order to perform AE, AF,and AWB.

The image processing unit 5175 includes a processor such as a CPU or aGPU, and the processor is operated according to a predetermined program,and thus, the image processing or the detection processing describedabove, can be performed. Note that, in a case where the image processingunit 5175 includes a plurality of GPUs, the image processing unit 5175suitably divides information associated with the image signal, andperforms the image processing in parallel, by the plurality of GPUs.

The control unit 5177 performs various controls relevant to the imagingof the surgery portion by the endoscope 5115, and the display of thecaptured image. For example, the control unit 5177 generates the controlsignal for controlling the driving of the camera head 5119. At thistime, in a case where the imaging condition has been input by the user,the control unit 5177 generates the control signal on the basis of theinput by the user. Alternatively, in a case where the AE function, theAF function, and the AWB function are provided in the endoscope 5115,the control unit 5177 suitably calculates an optimal exposure value,focal point distance, and white balance, according to the result of thedetection processing by the image processing unit 5175, and generatesthe control signal.

Furthermore, the control unit 5177 displays the image of the surgeryportion on the display apparatus 5155, on the basis of the image signalsubjected to the image processing by the image processing unit 5175. Atthis time, the control unit 5177 recognizes various objects in thesurgery portion image, by using various image recognition technologies.For example, the control unit 5177 detects the shape, the color, or thelike of the edge of the object included in the surgery portion image,and thus, it is possible to recognize a surgical tool such as forceps, aspecific biological portion, bleed, mist at the time of using the energytreatment tool 5135, and the like When the image of the surgery portionis displayed on the display apparatus 5155, the control unit 5177displays various surgery support information to be superimposed on theimage of the surgery portion, by using a recognition result. The surgerysupport information is displayed to be superimposed, and is presented tothe surgery operator 5181, and thus, surgery can be progressed moresecurely and reliably.

The transmission cable 5179 connecting the camera head 5119 and the CCU5153 together, is an electrical signal cable corresponding to thecommunication of the electrical signal, an optical fiber correspondingto the optical communication, or a composite cable thereof.

Here, in the shown example, the communication is performed in a wiredmanner, by using the transmission cable 5179, but the communicationbetween the camera head 5119 and the CCU 5153, may be performed in awireless manner. In a case where the communication between the camerahead 5119 and the CCU 5153 is performed in a wireless manner, it is notnecessary that the transmission cable 5179 is laid in the surgery room,and thus, a problem in which the movement of the medical staff in thesurgery room is hindered by the transmission cable 5179 can be solved.

An example of the surgery room system 5100 to which the technologyaccording to the present disclosure can be applied, has been described.Note that, here, a case where the medical system to which the surgeryroom system 5100 is applied, is the endoscope surgery system 5113, hasbeen described as an example, but the configuration of the surgery roomsystem 5100 is not limited to such an example. For example, the surgeryroom system 5100 may be applied to a flexible endoscope system for atest or a microscope surgery system, instead of the endoscope surgerysystem 5113.

The technique according to the present disclosure can be suitablyapplied to the IP converter apparatus (IPC) 5110 among theconfigurations described above. Specifically, as the IP converterapparatus (IPC) 5110, the IP converter reception apparatus 55 shown inFIGS. 3, 5, and 7 of the present disclosure can be preferably applied.By applying the technology according to the present disclosure to the IPconverter apparatus (IPC) 5110, it is possible to suppress a reductionin resolution of an image that a surgery operator wants to see at a highresolution while responding to an increase in the number of connectionsof medical equipment that supply images.

Note that the present disclosure may adopt the configuration describedbelow.

<1> A reception apparatus including:

an acquisition unit that acquires an image from a plurality of pieces ofequipment; and

a plurality of compression units that compresses the image acquired bythe acquisition unit by selecting a compression method for each type ofthe image.

<2> The reception apparatus according to <1>, in which the compressionunit compresses the image acquired by the acquisition unit by selectingthe compression method by performing bit packing by switching a bitpacking method for each type of the image.

<3> The reception apparatus according to <2>, in which the compressionunit compresses the image acquired by the acquisition unit by selectingthe compression method by performing bit packing by switching the bitpacking method by switching a format of a component signal for each typeof the image.

<4> The reception apparatus according to <1>, in which the compressionunit compresses the image acquired by the acquisition unit by selectingthe compression method by switching a frame rate for each type of theimage.

<5> The reception apparatus according to <1>, in which the compressionunit compresses the image acquired by the acquisition unit by selectingthe compression method by switching a compression rate according to anarea of the image for each type of the image.

<6> The reception apparatus according to <1>, in which the compressionunit compresses the image acquired by the acquisition unit by selectingthe compression method by switching an encoding method for each type ofthe image.

<7> The reception apparatus according to <1>, in which

the image includes a medical image, and

the compression unit determines the type of the image on the basis ofinformation object definition (IOD) data of digital imaging andcommunications in medicine (DICOM) attached to the image acquired by theacquisition unit.

<8> The reception apparatus according to <7>, in which a type of themedical image includes at least an operative field image, an endoscopicimage, a laparoscopic image, a computed tomography (CT) image, amagnetic resonance imaging (MRI) image, or an X-ray image.

<9> The reception apparatus according to <1>, in which

the image includes a medical image, and

the compression unit determines the type of the image on the basis of ananalysis result of the image acquired by the acquisition unit.

<10> The reception apparatus according to <9>, in which the compressionunit determines the type of the image on the basis of an analysis resultof a spatial frequency analysis or an analysis result of a dynamic rangeanalysis of each channel of Y, Cb, and Cr signals in the image acquiredby the acquisition unit.

<11> The reception apparatus according to <9>, in which the compressionunit determines whether or not the type of the image is an endoscopicimage on the basis of whether or not a round, black mask is present at aperipheral portion of the image in the analysis result of the image.

<12> The reception apparatus according to <9>, in which the compressionunit determines whether or not the type of the image is either anX-image or a CT-image on the basis of whether or not the image isgrayscale in the analysis of the image.

<13> The reception apparatus according to any of <1> to <12>, furtherincluding:

a transmission unit that transmits a plurality of images compressed bythe plurality of compression units;

a generation unit that generates a single picture in picture (PinP)image by image processing that combines the plurality of imagescompressed by the plurality of compression units and transmitted by thetransmission unit; and

an output unit that outputs the single picture in picture (PinP) imageto a display unit via the transmission unit and causes the display unitto display the single PinP image.

<14> The reception apparatus according to <13>, in which the compressionunit compresses the image acquired by the acquisition unit by selectinga compression method for each type of the image by switching a bitpacking format according to a processing load of a processor of thegeneration unit.

<15> The reception apparatus according to <14>, in which the compressionunit performs compression by selecting the compression method byswitching the bit packing format to either a format with a firstcompression rate including a format other than 16-bit alignment or aformat with a second compression rate having a compression rate lowerthan the first compression rate including the format of the 16-bitalignment according to the processing load of the processor of thegeneration unit.

<16> The reception apparatus according to <15>, in which the compressionunit performs compression

by selecting the compression method by switching the bit packing formatto the format with the first compression rate including the format otherthan the 16-bit alignment when the processing load of the processor ofthe generation unit is smaller than a predetermined value and byswitching the bit packing format to the format with the secondcompression rate having a compression rate lower than the firstcompression rate including the format of the 16-bit alignment when theprocessing load of the processor of the generation unit is larger thanthe predetermined value.

<17> The reception apparatus according to <13>, in which thetransmission unit includes peripheral component interconnect express(PCIe).

<18> The reception apparatus according to <13>, in which the compressionunit performs compression by selecting the compression method accordingto a display function of the display unit in a case where the imageincludes a 3D compatible image.

<19> A reception method including:

acquisition processing of acquiring an image from a plurality of piecesof equipment; and

compression processing of compressing the image acquired by theacquisition processing by selecting a compression method for each typeof the image.

<20> An image processing system including:

an image server that stores an image from a plurality of pieces ofequipment; and

a reception apparatus that acquires an image from the image server,outputs the image to a display unit, and causes the display unit todisplay the image,

in which

the image server stores an image from the plurality of pieces ofequipment and includes an output unit that outputs the stored image tothe reception apparatus, and

the reception apparatus includes

an acquisition unit that acquires the image from the plurality of piecesof equipment from the image server and

a plurality of compression units that compresses the image acquired bythe acquisition unit by selecting a compression method for each type ofthe image.

REFERENCE SIGNS LIST

-   11 IP converter reception apparatus (IPC-Rx)-   31 Input unit (Network Rx)-   32, 32-1 to 32-n Decoder-   33 Expansion bus (peripheral component interconnect express (PCIe))-   34 Graphics processing unit (GPU)-   35 Output unit (serial digital interface (SDI))-   40 Intra-hospital image processing system-   50 Camera-   51 Camera control unit (CCU)-   52 IP converter transmission apparatus (IPC-Tx)-   71 Input unit (Network Rx)-   72, 72-1 to 72-n Decoder-   73, 73-1 to 73-n Bit packing unit (BitPack)-   74 Bit packing control unit (PackingCtrl)-   75 Table-   76 Expansion bus (peripheral component interconnect express (PCIe))-   77 Graphics processing unit (GPU)-   78 Output unit (serial digital interface (SDI))-   91, 91-1 to 91-n Encoder (Enc)-   92 Table-   93 Graphics processing unit (GPU)-   111, 111-1 to 111-n Decoder (Dec)-   131, 131-1 to 131-n Bit packing unit (BitPack)-   132 Bit packing control unit (PackingCtrl)-   133 GPU-   151 Processor

1. A reception apparatus comprising: an acquisition unit that acquiresan image from a plurality of pieces of equipment; and a plurality ofcompression units that compresses the image acquired by the acquisitionunit by selecting a compression method for each type of the image. 2.The reception apparatus according to claim 1, wherein the compressionunit compresses the image acquired by the acquisition unit by selectingthe compression method by performing bit packing by switching a bitpacking method for each type of the image.
 3. The reception apparatusaccording to claim 2, wherein the compression unit compresses the imageacquired by the acquisition unit by selecting the compression method byperforming bit packing by switching the bit packing method by switchinga format of a component signal for each type of the image.
 4. Thereception apparatus according to claim 1, wherein the compression unitcompresses the image acquired by the acquisition unit by selecting thecompression method by switching a frame rate for each type of the image.5. The reception apparatus according to claim 1, wherein the compressionunit compresses the image acquired by the acquisition unit by selectingthe compression method by switching a compression rate according to anarea of the image for each type of the image.
 6. The reception apparatusaccording to claim 1, wherein the compression unit compresses the imageacquired by the acquisition unit by selecting the compression method byswitching an encoding method for each type of the image.
 7. Thereception apparatus according to claim 1, wherein the image includes amedical image, and the compression unit determines the type of the imageon a basis of information object definition (IOD) data of digitalimaging and communications in medicine (DICOM) attached to the imageacquired by the acquisition unit.
 8. The reception apparatus accordingto claim 7, wherein a type of the medical image includes at least anoperative field image, an endoscopic image, a laparoscopic image, acomputed tomography (CT) image, a magnetic resonance imaging (MRI)image, or an X-ray image.
 9. The reception apparatus according to claim1, wherein the image includes a medical image, and the compression unitdetermines the type of the image on a basis of an analysis result of theimage acquired by the acquisition unit.
 10. The reception apparatusaccording to claim 9, wherein the compression unit determines the typeof the image on a basis of an analysis result of a spatial frequencyanalysis or an analysis result of a dynamic range analysis of eachchannel of Y, Cb, and Cr signals in the image acquired by theacquisition unit.
 11. The reception apparatus according to claim 9,wherein the compression unit determines whether or not the type of theimage is an endoscopic image on a basis of whether or not a round, blackmask is present at a peripheral portion of the image in the analysisresult of the image.
 12. The reception apparatus according to claim 9,wherein the compression unit determines whether or not the type of theimage is either an X-image or a CT-image on a basis of whether or notthe image is grayscale in the analysis of the image.
 13. The receptionapparatus according to claim 1, further comprising: a transmission unitthat transmits a plurality of images compressed by the plurality ofcompression units; a generation unit that generates a single picture inpicture (PinP) image by image processing that combines the plurality ofimages compressed by the plurality of compression units and transmittedby the transmission unit; and an output unit that outputs the singlepicture in picture (PinP) image to a display unit via the transmissionunit and causes the display unit to display the single PinP image. 14.The reception apparatus according to claim 13, wherein the compressionunit compresses the image acquired by the acquisition unit by selectinga compression method for each type of the image by switching a bitpacking format according to a processing load of a processor of thegeneration unit.
 15. The reception apparatus according to claim 14,wherein the compression unit performs compression by selecting thecompression method by switching the bit packing format to either aformat with a first compression rate including a format other than16-bit alignment or a format with a second compression rate having acompression rate lower than the first compression rate including theformat of the 16-bit alignment according to the processing load of theprocessor of the generation unit.
 16. The reception apparatus accordingto claim 15, wherein the compression unit performs compression byselecting the compression method by switching the bit packing format tothe format with the first compression rate including the format otherthan the 16-bit alignment when the processing load of the processor ofthe generation unit is smaller than a predetermined value and byswitching the bit packing format to the format with the secondcompression rate having a compression rate lower than the firstcompression rate including the format of the 16-bit alignment when theprocessing load of the processor of the generation unit is larger thanthe predetermined value.
 17. The reception apparatus according to claim13, wherein the transmission unit includes peripheral componentinterconnect express (PCIe).
 18. The reception apparatus according toclaim 13, wherein the compression unit performs compression by selectingthe compression method according to a display function of the displayunit in a case where the image includes a 3D compatible image.
 19. Areception method comprising: acquisition processing of acquiring animage from a plurality of pieces of equipment; and compressionprocessing of compressing the image acquired by the acquisitionprocessing by selecting a compression method for each type of the image.20. An image processing system comprising: an image server that storesan image from a plurality of pieces of equipment; and a receptionapparatus that acquires an image from the image server, outputs theimage to a display unit, and causes the display unit to display theimage, wherein the image server stores an image from the plurality ofpieces of equipment and includes an output unit that outputs the storedimage to the reception apparatus, and the reception apparatus includesan acquisition unit that acquires the image from the plurality of piecesof equipment from the image server and a plurality of compression unitsthat compresses the image acquired by the acquisition unit by selectinga compression method for each type of the image.